System and method of connecting a caller to a recipient based on the recipients status and relationship to the caller

ABSTRACT

An example method comprising receiving a plurality of categories of availability statuses, receiving a plurality of categories of different contact groups, identifying, for each contact, at least one contact group, receiving a plurality of rules for call handling, each of the plurality of rules being associated with at least one of the different availability statuses and at least one of the different contact groups, receiving a telephone call from a first caller, identifying a caller identifier of the first caller, determining a contact group of the first caller, determining a current availability status of the recipient, identifying an applicable rule based on the contact group of the first caller and the current availability status of the recipient, selecting an audio prompt based on the applicable rule, and presenting the audio prompt to the first caller based on the applicable rule, the audio prompt indicating a preference of communication.

The present application claims the benefit of U.S. Provisional PatentApplication No. 62/804,124 filed Feb. 11, 2019, and entitled “System andMethod of Connecting a Caller to a Recipient Based on the Recipient'sStatus and Relationship to the Caller” which is incorporated byreference herein.

FIELD OF THE INVENTION(S)

Embodiments of the present invention(s) relate generally to a platformwhich allows a recipient of a telephone call to dynamically select a waythe recipient communicates with others.

BACKGROUND

The advancement of mobile technology has made it possible for people tocommunicate or connect with other people almost anywhere and almostanytime. While communication is necessarily a multi-directional process,the caller (i.e., the individual trying to communicate with a recipient)chooses the best time and method of communication. Such times and/ormethods of communication are not necessarily convenient to therecipient. As the number of people attempting to communicate increases,each recipient receives an increasingly large number of interruptionsfrom different callers.

Even momentary distractions from work, appointments, time with family,and the like combine to reduce concentration, add confusion forplanning, reduce effectiveness, and add to annoyances. Instead of beingable to focus on one or more tasks, people are often interrupted. Evenif the calls go to voicemail, “micro interruptions” of calls andnotifications are distracting and can completely disrupt concentration.This waste of time and mental energy has a direct impact on productivityand life enjoyment.

Further, an increasing number of scam or spam callers using thecomputerized automatic dialer to deliver live or pre-recorded messagesfurther increases the amount of wasted time and wasted productivity.

One solution to the problem is to direct all phone calls to voicemailand turn off all notifications. The problem with this “one size fits allsolution” is that the recipient is ultimately forced to review all ofthe voicemails and triage recorded calls, which may result in emergencyor urgent calls being missed or delayed.

Further, although some calls may not be urgent, particular calls may beof personal importance to the recipient. Lumping calls together buriesthe call that the recipient may want to immediately return. By treatingall calls the same, the recipient of the calls, again, must spendvaluable time and concentration to sort through a batch of missedcommunications. This perpetuates a cycle of missed calls, voicemails,and rushed phone calls.

SUMMARY

An example nontransitory computer readable medium comprises instructionsexecutable by a processor. The instructions may be executable to performa method. The method may comprise receiving, from a recipient, aplurality of categories of availability statuses of the recipient, eachof the categories of the plurality of categories being associated with adifferent availability status, receiving a plurality of categories ofdifferent contact groups of the recipient, identifying, for each contactof a plurality of contacts, at least one contact group of the differentcontact groups, there being at least two contacts of the plurality ofcontacts belonging to at least two different contact groups, receiving aplurality of rules for call handling, each of the plurality of rulesbeing associated with at least one of the different availabilitystatuses of the recipient and at least one of the different contactgroups, there being at least two rules of the plurality of rules, eachrule of at least two rules being associated with different availabilitystatuses of the plurality of availability statuses, receiving atelephone call from a first caller, identifying a caller identifier ofthe first caller, determining a contact group of the first caller of thedifferent contact groups, determining a current availability status ofthe recipient at the time of the call from the first caller, the currentavailability status being from the availability statuses of therecipient, identifying an applicable rule of the plurality of rulesbased on the contact group of the first caller and the currentavailability status of the recipient, selecting an audio prompt of aplurality of audio prompts based on the applicable rule, each of theplurality of audio prompts including different information, andpresenting the audio prompt to the first caller based on the applicablerule, the audio prompt indicating a preference of how the recipientprefers for the first caller to communicate with the recipient.

In various embodiments, the different contact groups include a contactgroup of work contacts and a group of family contacts. The plurality ofcategories of availability statuses of the recipient may include “busy,”“free,” and “unavailable.” In some embodiments, the method furthercomprising receiving a selection of the current availability status fromthe recipient.

It will be appreciated that the method may further comprise determiningthe current availability status of the recipient based on one or moreentries of the recipient's calendar indicating an activity of therecipient at a particular time. In some embodiments, the audio prompt tothe first caller indicates that the first caller should send a text tothe recipient and the first caller is not given the opportunity leave avoicemail during the first caller's call. In some embodiments, themethod further comprises receiving a telephone call from a secondcaller, identifying a caller identifier of the second caller,determining a contact group of the second caller of the differentcontact groups, the contact group of the second caller being differentfrom the contact group of the first caller, identifying an applicablerule of the plurality of rules based on the contact group of the secondcaller and the current availability status of the recipient, and passingthe call from the second caller directly to the recipient based on theapplicable rule of the plurality of rules based on the contact group ofthe second caller and the current availability status of the recipient.In some embodiments, the method further comprises receiving a telephonecall from a third caller, identifying a caller identifier of the thirdcaller, determining a contact group of the third caller of the differentcontact groups, the contact group of the third caller being differentfrom the contact group of the first caller and the contact group of thesecond caller, identifying an applicable rule of the plurality of rulesbased on the contact group of the third caller and the currentavailability status of the recipient, and providing, based on theapplicable rule of the plurality of rules based on the contact group ofthe third caller and the current availability status of the recipient,an interactive audio system requesting the third caller to indicate iftheir call is urgent, and if the call is urgent then passing the call tothe recipient, otherwise passing their call to a voicemail system.

In various embodiments, the method further comprises receiving, afterthe audio prompt, from the first caller a time when the caller isavailable for a return call from the recipient, determining if therecipient's calendar indicates that the time when the first caller isavailable for the return call from the recipient is available for therecipient, and if the recipient's calendar indicates that the time whenthe first caller is available, then providing an indication in therecipient's calendar regarding the return call and providing anindication that the time is calendared to the first caller.

An example method comprise receiving, from a recipient, a plurality ofcategories of availability statuses of the recipient, each of thecategories of the plurality of categories being associated with adifferent availability status, receiving a plurality of categories ofdifferent contact groups of the recipient, identifying, for each contactof a plurality of contacts, at least one contact group of the differentcontact groups, there being at least two contacts of the plurality ofcontacts belonging to at least two different contact groups, receiving aplurality of rules for call handling, each of the plurality of rulesbeing associated with at least one of the different availabilitystatuses of the recipient and at least one of the different contactgroups, there being at least two rules of the plurality of rules, eachrule of at least two rules being associated with different availabilitystatuses of the plurality of availability statuses, receiving atelephone call from a first caller, identifying a caller identifier ofthe first caller, determining a contact group of the first caller of thedifferent contact groups, determining a current availability status ofthe recipient at the time of the call from the first caller, the currentavailability status being from the availability statuses of therecipient, identifying an applicable rule of the plurality of rulesbased on the contact group of the first caller and the currentavailability status of the recipient, selecting an audio prompt of aplurality of audio prompts based on the applicable rule, each of theplurality of audio prompts including different information, andpresenting the audio prompt to the first caller based on the applicablerule, the audio prompt indicating a preference of how the recipientprefers for the first caller to communicate with the recipient.

An example system comprises at least one processor and memory. Thememory may include instructions to control the at least one processor toreceive, from a recipient, a plurality of categories of availabilitystatuses of the recipient, each of the categories of the plurality ofcategories being associated with a different availability status,receiving a plurality of categories of different contact groups of therecipient, identifying, for each contact of a plurality of contacts, atleast one contact group of the different contact groups, there being atleast two contacts of the plurality of contacts belonging to at leasttwo different contact groups, receiving a plurality of rules for callhandling, each of the plurality of rules being associated with at leastone of the different availability statuses of the recipient and at leastone of the different contact groups, there being at least two rules ofthe plurality of rules, each rule of at least two rules being associatedwith different availability statuses of the plurality of availabilitystatuses, receiving a telephone call from a first caller, identifying acaller identifier of the first caller, determining a contact group ofthe first caller of the different contact groups, determining a currentavailability status of the recipient at the time of the call from thefirst caller, the current availability status being from theavailability statuses of the recipient, identifying an applicable ruleof the plurality of rules based on the contact group of the first callerand the current availability status of the recipient, selecting an audioprompt of a plurality of audio prompts based on the applicable rule,each of the plurality of audio prompts including different information,and presenting the audio prompt to the first caller based on theapplicable rule, the audio prompt indicating a preference of how therecipient prefers for the first caller to communicate with therecipient.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 depicts a block diagram of an example environment capable ofdynamically selecting ways a recipient of a telephone call cancommunicate with others.

FIG. 2 depicts a block diagram of an example virtual assistant systemaccording to some embodiments.

FIG. 3 depicts a flow chart of registration and authentication of usersaccording to some embodiments.

FIG. 4 depicts a flow chart depicting a method of determining the ways acaller can communicate with a recipient who utilizes the virtualassistant system according to some embodiments.

FIG. 5 depicts a flow chart of different ways the virtual assistantsystem may connect a recipient of a telephone call with the caller whenthe virtual assistant system determines that the caller belongs to an“immediate family” contact group according to some embodiments.

FIG. 6 depicts a flow chart of different ways the virtual assistantsystem may connect a recipient of a telephone call with the caller whenthe virtual assistant system determines that the caller belongs to an“emergency” contact group according to some embodiments.

FIG. 7 depicts a flow chart of different ways the virtual assistantsystem may connect a recipient of a telephone call with the caller whenthe virtual assistant system determines that the caller belongs to a“friends” contact group according to some embodiments.

FIG. 8 depicts a flow chart of different ways the virtual assistantsystem may connect a recipient of a telephone call with the caller whenthe virtual assistant system determines that the caller belongs to a“business” contact group according to some embodiments.

FIG. 9 depicts a flow chart of different ways the virtual assistantsystem may connect a recipient of a telephone call with the caller whenthe virtual assistant system determines that the caller belongs to a“blocked” or “unlisted” contact group according to some embodiments.

FIG. 10 depicts an example calendar of a user of a mobile systemreceived by the virtual assistant system using an API according to someembodiments.

FIG. 11 depicts an example availability status calendar according tosome embodiments.

FIG. 12 depicts an example summary user interface summarizing keystatistics of the recipient's use of the virtual assistant system,according to some embodiments.

FIG. 13 depicts a method of text message exchange between a caller and arecipient according to some embodiments.

FIG. 14 depicts a table of the priority of various contact groupsdepending on the availability status according to some embodiments.

FIG. 15 depicts a table of the status of the text message based on thecurrent availability status and the contact group the caller belongs toaccording to some embodiments.

FIG. 16 depicts a block diagram of an example computing device accordingto some embodiments.

DETAILED DESCRIPTION

A virtual assistant system may enable a user (i.e., a call recipient) toengage in communicating with others in a time and manner that the userprefers. The virtual assistant may, for example, enable a user toautomate different actions for managing communications based on: thetype of communication, the availability status of the user when thecommunication is received, and the identity of the person attempting toreach the user. Further, the virtual assistant may automatecommunication with the caller to inform them how the user prefers tocommunicate and when. The virtual assistant may allow the user toindicate a preference for different types of communication-based on theidentity of the person and/or the availability status of the user.

The virtual assistant system may manage communication from others(trying to reach the user) based on: (1) the availability status of therecipient (i.e., the user being called); and (2) the recipient'srelationship with the person trying to reach the recipient. The virtualassistant system may allow the recipient of the call (e.g., the user ofthe virtual assistant system) to manually or dynamically set theiravailability status, group callers into groups, and create rules torespond to phone calls and other communications based on theiravailability, the relationship of the recipient with the personattempting to reach the recipient, and rules created by the recipient.

The availability status of the recipient includes a variety of differentcategories indicating a real-time state of the recipient. In oneexample, the recipient may manually set their availability status to anyof several categories including, but not limited to “busy,” “sleep,” “donot disturb,” and “free.” A “busy” status may represent a time in whichthe recipient is not receptive to non-emergency communications (e.g.,calls, text messages, or email) from people who do not have a closerelationship with the caller. A “sleep” status may represent an extendedtime of inactivity such as during the hours the recipient is sleepingand watching a movie. A “do not disturb” status may represent a periodof time in which the recipient is in a meeting and is not receptive tonon-emergency messages. There may be any number of availability statuscategories. Other categories may include, for example, “in a meeting,”“work,” “family time,” “on vacation,” “unavailable,” or the like. Therecipient may create their own availability status categories.

Like the availability status categories, the user may group peopleand/or devices into any number of contact groups and may label orcategorize each group. In one example, the recipient may label contactgroups as “close family,” “emergency,” “critical businessrelationships,” “friends,” “business associates,” “marketing,” and thelike. A potential messenger (e.g., individual who may attempt tocommunicate with the user or recipient) may be placed in only onecontact group or, in some embodiments, multiple contact groups. Thevirtual assistant system may assign an individual and/or device that isnot otherwise within a predefined contact group as “default” or“unknown.”

The virtual assistant system may receive from the user of the mobiledevice rules for managing communications from individuals of differentgroups based on each of the different availability statuses. Forexample, a user may configure one or more rules to indicate: when callsfrom a caller or contact group may reach the recipient when calls from acaller or contact group are directed to voicemail, which audio promptsmay be provided to a caller, call screening options, and/or the like.

When a person calls a recipient, for example, the virtual assistantsystem may determine the caller's contact group and the availabilitystatus of the user (i.e., the recipient). The virtual assistant systemmay then engage in a variety of different actions based on the rulesestablished by the recipient. Based on the recipient's contact group andthe availability status of the recipient, the virtual assistant systemmay pass the call to the recipient, direct the call to voicemail,present different voice prompts to the caller to request information(e.g., to request information for voicemail or provide the caller withan interactive menu with options as established by the user of thesystem), provide information as to the recipient's preferred time and/orcommunication type (e.g., the caller may prefer texts from non-workfriends rather than voicemail), and/or present different choices to thecaller.

As such, the recipient may control when they may be interrupted. Therecipient may also control and automate communication with peopleattempting to reach the recipient (e.g., callers, people who send textmessages, people who send email, and/or any other form of communication)regarding how the recipient prefers to be contacted. As a result, therecipient may communicate with others in a time, place, and manner ofthe recipient's preference.

The virtual assistant system may be software installed on therecipient's mobile system. In some embodiments, the mobile system is asmartphone and/or a system that is in communication with the recipient'ssmartphone. In some embodiments, the virtual assistant system is aweb-based application which may be accessed by navigating to aparticular web page on the internet.

FIG. 1 depicts a block diagram of an example environment 100 including avirtual assistant system 110 capable of dynamically selecting a way arecipient of a telephone call can communicate with callers The exampleenvironment 100 includes a first mobile system 102, a second mobilesystem 104, a third mobile system 106, a communication network 108, avirtual assistant system 110, and a spam caller datastore 112. The firstmobile system 102, the second mobile system 104, the third mobile system104, and the virtual assistant system 110 may each be or include anynumber of digital devices. A digital device is any device with aprocessor and memory. Digital devices are further discussed herein(e.g., see FIG. 16).

The first mobile system 102, second mobile system 104, and third mobilesystem 106 may facilitate communication between users of the mobilesystems and other associated systems. In some embodiments, the firstmobile system 102, second mobile system 104, and third mobile system 106may be or include one or more mobile devices (e.g., smartphones, cellphones, smart watches, tablet computer, or the like), desktop computers,laptop computers, and/or the like.

The communication network 108 represents one or more computer networks(e.g., LANs, WANs, cellar networks, POTs networks, and/or the like). Thecommunication network 108 may provide communication between any of thefirst, second, and third mobile systems 102, 104, and 106, the virtualassistant system 110, and the spam caller datastore 112. In someimplementations, the communication network 108 comprises computerdevices, routers, cables, uses, and/or other network topologies. Thecommunication network 108 may be wired and/or wireless. In variousembodiments, the communication network 108 may comprise the Internet,one or more networks that may be public, private, IP-based, non-IPbased, and so forth.

The virtual assistant system 110, further described herein, may be apart of any number of the mobile system(s). When the recipient (e.g.,the user of the first mobile system 102 and the virtual assistant system110) receives a call from a caller (e.g., a call coming from the secondmobile system 104), the virtual assistant system 110 may determine thecurrent availability status of the recipient and the contact group thatthe caller belongs. The virtual assistant system 110 may determine thecurrent availability status of the recipient by retrieving a currentavailability status (e.g., manually set by the recipient, set based ontime and/or date, set based on the recipient's calendar, and/or setbased on the user's assistant). The virtual assistant system 110 maydetermine the contact group of the caller by comparing a calleridentification, caller ID, and/or other identifiers (e.g., calleridentifications and/or caller IDs) to a group list and/or members ofdifferent contact groups associated with the recipient.

With this information, the virtual assistant system 110 may determinehow to respond to the incoming call based on a variety of predefinedrules from the recipient. For example, the virtual assistant system 110may determine that the availability status of the recipient is set to a“free” status. The virtual assistant system 110 may receive from thesecond mobile system 104 the caller ID and determine if the secondmobile system 102 belongs to a particular contact group. Based on apredefined rule which instructs the virtual assistant system 110 toprovide calls from the particular contact group to the recipient whenthe recipient's availability status is “free.” Alternately, the virtualassistant system 110 may direct the call to the recipient (e.g., causingthe recipient's smart phone to provide an audio and/or hapticnotification of a call, text, or other communication), provide an audioprompt to the caller that requests additional information, provide anaudio prompt to inform the caller when the recipient may be free,provide an audio prompt to inform the caller that the recipient prefersto communicate using a different medium (e.g., text or email), or blockthe call.

In another example, the virtual assistant system 110 may determine thatthe caller and/or the second mobile system 104 belongs to an “immediatefamily” contact group. In response to the virtual assistant system 110determining that the availability status is set to “working” status andthat the caller is from the “immediate family” contact group, thevirtual assistant system 110 may apply a rule that allows the call fromthe first mobile system 102 to ring through to the first mobile system102 while calls from individuals of other contact groups may be treateddifferently.

Depending on the availability status and the contact group that thecaller belongs, the virtual assistant system 110 may provide differentaudio prompts (e.g., messages provided to the caller in a voicemailsystem). For example, if the availability status of the recipient is “ina meeting,” the virtual assistant system 110 may provide an audio promptto the caller from the “immediate family” contact group which indicatesthat the recipient may get back as soon as possible. In someembodiments, if the caller is from a different contact group such as the“business colleague” contact group, an audio prompt may indicate whenthe recipient anticipates being free (and/or how long the recipientexpects to be busy). In another example, a caller associated with abusiness group may receive an audio prompt requesting the caller toleave behind a preferred time and/or date that the caller gets back tothe caller.

In some embodiments, the virtual assistant system 110 may store thecaller's response in voicemail, convert all or a portion of the responseto text and provide the text to the user recipient in the form of a textmessage or email, insert a time entry into the recipient's calendar toblock off the time for the recipient to communicate with the caller, orthe like. In various embodiments, the virtual assistant system 110 maysort stored voicemails based on when the caller's preferred time and/ordate of response to assist the recipient in reviewing the most urgentvoicemails first.

Although many of these examples indicate calls, it may be appreciatedthat the virtual assistant system 110 may manage any type ofcommunication including text, email, one-way audio communication, and/orany notifications.

In some embodiments, if the virtual assistant system 110 determinesthat, based on one or more predefined rules, the caller's contact group,and the recipient's availability status, that the recipient is not toreceive the caller's call. In some embodiments, the virtual assistantsystem 110 may provide a voice prompt to the caller indicating when therecipient is free. In various embodiments, the virtual assistant system110 may check the recipient's calendar to check when the user may benext free or is otherwise not blocked by a commitment (e.g., duringworking hours or within a predefined range of time established by therecipient).

The virtual assistant system 110 may be configured to check the calendarand, if the recipient is free, provide an indication when the recipientis free in a voice prompt to the caller which may encourage to callduring these times. For example, the virtual assistant system 110 maydetermine through checking the recipient's calendar that, at the time ofthe call, a later time is identified as “free” or is otherwise notblocked by a commitment. The virtual assistant system 110 may beconfigured to check the calendar and, if the recipient is free, providean indication when the recipient is free in a voice prompt to the callerwhich may encourage to call during these times.

The virtual assistant system 110 may hold any number of text messages,voicemail, notifications of the text message, or notifications ofvoicemail until the virtual assistant system 110 determines that therecipient's availability status is “free” or is a status where the userhas indicated it is acceptable to receive voicemail messages and/or textmessages. It may be appreciated that the virtual assistant system 110may be configured by the user to indicate times or particularavailability statuses where text messages may be provided to the userbut not voicemails. Similarly, the virtual assistant system 110 may beconfigured to provide voicemails and/or text messages at other times orat particular availability statuses.

In some embodiments, the virtual assistant system 110 may wait apredetermined amount of time (e.g., a predetermined connection period)after the caller from a particular group calls the recipient to pass thecall through. The predetermined connect period may change depending onthe status of the recipient. For example, when the availability statusis set to “personal,” the virtual assistant system 110 may connect thecall 2 seconds after the virtual assistant system 110 generates an audiomessage or text message identifying the caller. In one embodiment, thepredetermined connect period may be used to determine the period of timeto wait for the recipient to interact with their respective mobilesystem before disconnecting the call or sending an audio prompt (such asa voicemail prompt) to the caller.

The spam caller datastore 112 may be any structure and/or structuressuitable for storing digital content (e.g., an active database, arelational database, a self-referential database, a table, a matrix, anarray, a flat file, a documented-oriented storage system, anon-relational No-SQL system, an FTS-management system such asLucene/Solar, and/or the like). The spam caller datastore 112 may storecaller IDs of callers who either are or are suspected to be spam caller(e.g., advertisements, unrequested robotic calls, known scams, those ona “do not call” list, and the like).

The spam caller datastore 112 may include or be a centralized systemwhere calls identified as being a spam or scam call (e.g., by beinglabeled by users of the virtual assistant system 110, from a do-not-calllist, AT&T list of suspected calls, a Robocall list, and/or the like).Different users of the virtual assistant system 110 may rely on the spamcaller datastore 112. For example, the virtual assistant system 110 mayreceive a call and check against the spam caller datastore 112 todetermine if the call is likely a spam call or a scam call.

With the advancing telephone number spoofing technologies, scammers orspammers may spoof phone numbers and/or other identifiers to hide acaller ID of the scammer or spammer. In some embodiments, the spamcaller datastore 112 may store the caller IDs of scam callers.

In various embodiments, the virtual assistant system 110 determine if acalling number may be a spam or scam call by keeping count of a numberof times a particular caller ID shows up as an entry in the spam callerdatastore 112. The virtual assistant system 110 may determine that atthe particular caller ID is not a suspected scam caller if the number oftimes the particular caller ID shows up as an entry in the spam callerdatastore 112 is less than a predetermined number of times.

In various embodiments, all or part of the virtual assistant system 110may be a part of the first mobile system 102. In one example, the firstmobile system 102 includes the virtual assistant system 110. The virtualassistant system 110 may be a part of the operating system of the firstmobile system 102 or with the operating system of the first mobilesystem 102. For example, the virtual assistant system 110 may replace orwork with a call management and/or voicemail function of an operatingsystem (e.g., with Android OS). In one example, as telephone calls comeinto the first mobile system 102, the virtual assistant system 110 mayreceive or intercept the call, identify the caller, and take appropriateaction as discussed herein.

Alternately, the virtual assistant system 110 may work with theoperating system. In one example, telephone calls come into theoperating system of the mobile system 102. The virtual assistant system110 may intercept the call (e.g., through a redirect function enabledthrough the operating system) or receive a hand-off of the call (e.g.,through an API), to extend the mobile system's functionality. Similarly,voicemail functionality (including different voice prompts to differentcallers) may be provided by the virtual assistant system 110 byreplacing a part of the operating system or working with a part of theoperating system (e.g., through APIs).

FIG. 2 depicts a block diagram of an example virtual assistant system110 according to some embodiments. The example virtual assistant system110 includes a communication module 202, a management module 204, aregistration module 206, an authentication module 208, a contact groupmodule 210, an availability status module 212, a rules module 214, alocation module 216, a scheduling module 218, an availability statusmodule 212, and a contact group datastore 222.

It may be appreciated that all or part of the virtual assistant system110 may be on the recipient's smart phone (e.g., communication device)or a system in communication with the recipient's communication devicevia the communication network 108.

In some embodiments, the communication module 202 sends and receivesdata and request(s) between any one of the modules or datastore of thevirtual assistant system 110 to another of the modules or datastore ofthe virtual assistant system 110. The communication module 202 may sendand receive data and request(s) between any of the modules or datastoreof the virtual assistant system 110 and any of the systems of theenvironment 100 of FIG. 1.

The management module 204 may manage any number of modules of thevirtual assistant system 110. In various embodiments, the managementmodule 204 receives calls (e.g., directly from a smart device and/or byintercepting calls), determines the contact group of the caller usinginformation from the contact group module 210, determines theavailability status of the recipient using the availability statusmodule 212, and executes the applicable rule(s) from the rules module214.

In various embodiments, the registration module 206 creates and updatesaccounts for users of mobile system. For example, the management module204 may receive a request to register a user of a mobile system, such asthe first mobile system 102. The management module 204 may send therequest to the registration module 206.

The registration module 206 may create and/or update account informationfor users. In some embodiments, the registration module 206 requires theuser to include user identification information when registering a newaccount. User identification may include an email address, password,another email account(s) associated with the user, and phone number.

For example, the registration module 206 may allow a user to registerand enables the authentication module 208 to authenticate the user'slogin and password. During a registration process, the user may providetheir contact information to the virtual assistant system 110. In someembodiments, the contact information includes email account(s), uniqueidentifiers, and/or phone numbers associated with the user.

The authentication module 208 may authenticate a user's login andpassword. The login and password may be associated with the user'saccount. The authentication module 208 may authenticate a user bycomparing the user's login and password using a database of registeredusers. It may be appreciated that users may be authenticated in manyways, including, but not limited to, device identifiers, biometrics,encryption keys, cookies, and/or the like.

The contact group module 210 may categorize any number of the user'spotential callers (e.g., from a user's contacts listing in the user'scommunication device) into one or more contact groups for use by thevirtual assistant system 110. Each contact and/or contact group may bestored by the contact group module 210 into the contact group datastore222 in the form of a contact entry. Each contact entry may include aname of the contact, a nickname of the contact, at least one phonenumber associated with the contact, and/or at least one label (e.g., acontact group identifier) for each phone number. The contact groupidentifier may identify any number of groups that the contact (e.g.,potential caller) may belong.

In various embodiments, the contact group module 210 may identifycontacts on the user's mobile device. For example, the contact groupmodule 210 may send a request to the management module 204 to make anAPI call to the user's mobile system for the contacts in the user'smobile system's contact list. Further or alternately, the contact groupmodule 210 may receive one or more designations from the user indicatingone or more contacts and/or phone numbers to associate with any numberof new or pre-existing contact groups.

In some embodiments, the contact group module 210 may receive from theuser, customized labels (e.g., names or identifiers) for each of themultiple contact groups, or the user may choose to use default contactgroup labels. Some examples of labels for contact groups include“immediate family,” “emergency,” “friends,” “business,” “blocked,”and/or “unlisted.” It may be appreciated that the user may designate orchange a contact group for any number of contacts. Further, the user maycreate any number of contact groups and identify them in any way theywant (e.g., label each group individually in any way they like includingdifferent languages, emoticons, whimsical names, and/or the like).

Contact group membership may change as needed. For example, a userwaiting to hear back from the doctor may add a phone number for thedoctor's office to an “emergency” contact group. After a crisis resolvesor after a particular call, the user may change the contact groupassociated by the doctor to another group (e.g., a “next appointmentreminder” contact group or the like).

In some embodiments, a caller may belong to one or more contact groups.For example, a contact may be in the “friend” contact group as well as a“business colleague” contact group and/or “supervisor” contact group.

The availability status module 212 may be configured to create differentavailability statuses. An availability status refers to a state of theuser that affects availability to be reached by one or more callers. Invarious embodiments, a user may identify any number of availabilitystatuses including, for example, “free,” “personal time,” “in ameeting,” “unavailable,” or the like. The availability status module 212may receive any number of availability statuses from the user and storethe availability statuses.

In various embodiments, the virtual assistant system 110 may determinethe availability status of the user when a caller calls. For example,the user may manually select a current availability status from aninterface (e.g., selecting “in a meeting” prior to walking into ameeting). When a caller calls, the virtual assistant system 110 (e.g.,the management module 204) may determine that the user is “in a meeting”and determine which contact group that the caller belongs. The virtualassistant system 110 may then execute a rule to take action based on thecontact group and current availability status.

The rules module 214 is configured to create one or more rules based onthe user's input. Each rule indicates one or more actions that thevirtual assistant system 110 may take based on contact group and therecipient's availability status at the time of the call.

For example, the user may create a rule that indicates when a callerfrom the “emergency” contact group calls, the virtual assistant system110 passes those calls directly to the user regardless of availabilitystatus. In another example, the user may create a rule that indicateswhen a caller from a “business colleague” contact group calls and theuser is in the “business meeting” availability status, the virtualassistant system 110 may play a particular audio prompt to the caller.

There may be any number of audio prompts. For example, an audio promptmay indicate that the user is in a meeting and request any number ofactions including, for example, that the caller leave a voicemail and atime when they are available for a return call, that the caller shouldcall back later, that the caller should send a text to the user with amessage, or that the caller should send an email. In some embodiments,based on the applicable rule (triggered by the caller's contact groupand the recipient's availability status), the user's communicationdevice provides an interactive system to enable the recipient to press anumber if it is an emergency to enable the virtual assistant system 110to pass the call through to the recipient in an emergency.

It may be appreciated that there may be any number of rules indicatingdifferent actions to take depending on the contact group andavailability status. In various embodiments, the user may designate adefault action to be taken if there are no rules that are applicable(e.g., the default action being to play a particular voice prompt toindicate to the caller to leave a voice or text message).

In some embodiments, the location module 216 determines the location ofthe recipient. The location module 216 may determine this information bysending an API request to the mobile system of the recipient to requestthe current location according to the global positioning system (GPS) ofthe mobile system. Based on the location information associated with therecipient, the availability status module 212 may determine anapplicable availability status.

In various embodiments, the user may categorize different locations(e.g., based on GPS coordinates) and associate the different locationswith different availability statuses. For example, the user maydesignate a “home” location and when location information indicates whenthe user is at home, the availability status of “personal” or “do notdisturb” may be applied. Similarly, if the user designates a “gym”location and the user is at the gym, the availability status of “workingout,” “do not disturb,” or “interruptions for work only” may be applied.

For example, if the user did not manually set an availability status andthe virtual assistant system 110 receives a call, the availabilitystatus module 212 may retrieve location information from the locationmodule 216. If the location information indicates that the user is athome, then the availability status module 212 may set the availabilitystatus to “personal” and apply rules based on that availability statusand the recipient's contact group. If the location information indicatesthat the user is at the gym, then the availability status module 212 mayset the availability status to “busy-personal” and apply rules based onthat availability status and the recipient's contact group.

In some embodiments, the user may set a rule that when the locationinformation indicates that the user is not within a particulargeographic area (e.g., a range of GPS coordinates), then the user isassociated with an availability status of “unavailable” or “onvacation.” As such, there may be a rule that indicates that all calls ormessages received while the user is geographically unavailable (e.g.,not within a particular geographic area) may be directed to voicemailand/or converted to text and sent to text messages.

The scheduling module 218 may determine an availability status of therecipient and/or the availability for later communication based on therecipient's calendar. In various embodiments, the virtual assistantsystem 110 may check the recipient's calendar or other indicationprovided by the recipient to indicate a time that is convenient to theuser or to make suggestions. For example, the virtual assistant system110 may receive a text from a caller, the virtual assistant system 110may determine the caller's contact group based on the caller's cellnumber, determine the recipient's availability status, identify theapplicable predefined rule to determine that the recipient is notavailable, check the recipient's calendar or a predefined time foravailability, and provide a text message back to the caller indicatingwhen the recipient is available.

In some embodiments, the availability status module 212 may send arequest to the scheduling module 218 for the current recipient scheduleaccording to the scheduling module 218 (e.g., if the recipient'savailability cannot be otherwise determined). The scheduling module 218may receive and store a current availability manually provided by therecipient or check the recipient's calendar/schedule to determine if theuser is currently in a meeting or is otherwise occupied within a timethat is blocked off. Based on the calendar entry, the scheduling module218 may determine the recipient's availability status. In someembodiments, the recipient may relate different calendar types (e.g., ina meeting, blocked off, away, or the like) with one or more availabilitystatuses.

In some embodiments, the availability status module 212 may determinethe availability status regardless of the availability status receivedfrom the scheduling module 218. For example, the availability statusmodule 212 may receive a “work” status from the scheduling module 218;the availability status may set the current availability status to“work.”

In some embodiments, the availability status module 212 may make an APIrequest, via the management module 204, to more than one or more mobiledevices, cloud scheduling services, and the like to determine theschedule of the recipient and, as a result, determine the availabilitystatus of the recipient. In various embodiments, the scheduling module218 may make periodic calls to one or more scheduling applications,servers, services, cloud services, and/or the like to update the currentavailability status of the recipient. Additionally or alternately, thescheduling module 218 may make calls to one or more schedulingapplications, servers, services, cloud services, and/or the like toupdate the current availability status of the recipient when someonetries to reach the recipient.

It may be appreciated that a user of the virtual assistant system 110may purposefully identify times that may be provided to callers of oneor more contact groups to call the recipient (e.g., by blocking times ofthe calendar as “free for calls”). Although this time may overlap otheractivities, the user may control the virtual assistant system 110 toprovide that time to callers of one or more contact groups (e.g., asubset of contact groups but not all) to encourage them to call duringthese times. In this way, the user may control when they are likely toget important calls rather than getting all calls (important orotherwise) at any time.

It may be appreciated that the virtual assistant system 110 maycommunicate with callers using a voice prompt when they call. In someembodiments, the virtual assistant system 110 may communicate withcallers using a text message when the caller sends a text message.

In various embodiments, the virtual assistant system 110 may communicatewith the user to schedule a call via text message or using a message (oraudio prompt) to provide information regarding availability and requesta mutually convenient callback time.

In various embodiments, the virtual assistant system 110 may beinteractive through text messages. When a call is received, for example,the management module 204 may provide a text message back to the callerindicating when the recipient is available and/or how the recipientwould prefer to communicate (e.g., via text message or email rather thana voice call). In this example, after providing a text message back tothe caller indicating when the recipient is available, the managementmodule 204 may send a text message requesting whether a proposed timeand/or date is agreeable to the recipient (e.g., by indicating that theuser send a text with a number indicating that they may call at thattime). If agreeable, the virtual assistant system 110 may input acalendar entry (using an API for a calendar application) for therecipient blocking off the time for a predefined duration (e.g., tenminutes by default or a duration based on the contact group). If thattime is not available to the recipient, the recipient may text anindication (e.g., a different number or text) to the virtual assistantsystem 110 and the virtual assistant system 110 may check therecipient's calendar for a different time. The process may continueuntil an acceptable time is reached or the process is terminated.

In various embodiments, if the caller calls rather than provides a textmessage, the virtual assistant system 110 may provide an audio prompt torequest the caller to leave a text message or an audio message for therecipient (e.g., not allowing the caller to leave an voice mail).

In various embodiments, the virtual assistant system 110 may rely ondefault rules that automatically connects a call to a recipient from acaller identified to be in the “emergency” contact group (e.g., from aschool nurse, spouse, or surgeon) regardless of that caller's group.

In some embodiments, the management module 204 may use voice recognitionof the caller's voice to determine if the caller is interested insetting a time for a future communication and/or provide the caller withan opportunity to indicated preferences based on numerical or vocal cues(e.g., by proving a prompt indicating that if the caller is interestedin setting a time for a future call, the caller may input a numericalvalue such as “1” or say the word “one”). The management module 204 maycheck the recipient's calendar for an open, free, or otherwisedesignated time for calls and provide information by audio prompt backto the caller. The caller may then indicate if the time is acceptable orrequest a new time using their telephone keypad, vocal cues, or thelike. If agreeable, the management module 204 may input a calendar entry(using an API for a calendar application) for the recipient blocking offthe time for a predefined duration (e.g., ten minutes by default or aduration based on the contact group). If that time is not available tothe recipient, the recipient may provide an audio prompt an indicationto the caller. The virtual assistant system 110 may check therecipient's calendar for a different time. The process may continueuntil an acceptable time is reached or the process is terminated.

The automated message datastore 220 may include any number of audioprompts. In various embodiments, the virtual assistant system 110 mayexecute a rule based on the availability status of the recipient at atime of a call from the caller, and the caller's contact group. The rulemay retrieve or present any number of previously generated audioprompts. One audio prompt, for example, may indicate that the recipientis unavailable. Another audio prompt may request that the particularcaller provide a text message or send an email. Yet another audio promptmay include an interactive system where a caller may be asked toindicate if the call is an emergency and/or what times that the callermay be available for a return call.

The contact group datastore 222 may include any number of contactgroups. As discussed herein, the user may create any number of contactgroups. Each contact group may have a unique contact group identifier(relative to the other contact groups in the contact group datastore222). Each contact group may be associated with any number of users.

The automated message datastore 220 and the contact group datastore 222may include any type of storage in any type(s) of logical storage (e.g.,databases, tables, or the like).

FIG. 3 depicts a flow chart 300 of registration and authentication ofusers according to some embodiments. In step 302, the registrationmodule 206 receives a request to register a user with the virtualassistant system 110. When a new user registers, a user identifier(e.g., a login identifier) and password may be required.

The registration module 206 may create or update account information forusers. In some embodiments, the registration module 206 requires theuser to include user identification information when registering a newaccount. User identification may include email address(es), password,and phone number. In some embodiments, the user may include informationsuch as addresses for locations of interest to the user such as theworkplace, home, gym, etc.

In step 304, the authentication module 208 authenticates a user's loginand password when the user logs into the system. The login and passwordmay be associated with the user's account. The authentication module 208may authenticate a user by comparing the user's login and password witha database of registered users, passwords, and/or encryption keys. Itmay be appreciated that users may be authenticated in many ways,including, but not limited to, device identifiers, biometrics,encryption keys, cookies, and/or the like.

It may be appreciated that the virtual assistant system 110 may supportmultiple users of the same smart device with different profilesincluding different contact groups, different categories of availabilitystatuses, different calendars, different audio prompts, different rules,and/or the like.

In step 304, the management module 204 may send a request to the contactgroup module 210 to categorize the user's contacts into one or morecontact groups. Each contact may be stored in the contact groupdatastore 222 in the form of a contact entry. Each contact entry mayinclude a name of the contact, a nickname of the contact, at least onephone number associated with the contact, and/or a label (e.g.,identifier) for each phone number.

In step 306, the contact group module 210 may assist with the creationof categories for contact groups and assist with assigning one or morecontacts into one or more different contact groups. It may beappreciated that the user may organize any number of users in the user'scontacts or any other user with any number of contact groups. In someembodiments, the management module 204 may identify co-workers in theuser's contacts (e.g., by place of work identified in the user'scontacts) and associate them with a “work colleagues” group or the like.Similarly, the management module 204 may identify family, friends or thelike based on data or metadata in the user's contact and group themaccordingly. In some embodiments, the management module 204 may onlyassociate potential callers based on manual input by the user (e.g., viaan interface) and/or a combination of automatically and by user manualinput.

Each contact may belong to more than one contact group. Differentcontact groups may have different priority. The virtual assistant system110 may associate a higher priority of the one or more contact groups todetermine the choices presented to the caller. In some embodiments, if afirst contact belongs to a first contact group with a first priority anda second contact group with a second priority, the virtual assistantsystem 110 may determine an appropriate rule to apply based on whetherthe first or the second priority is higher (and/or utilize a defaultrule if the first and the second priority have the same level ofprioritization and/or neither group of the call has a prioritization).

In step 308, the registered and authenticated user may set categoriesfor different availability statuses and create one or more rules whichapply when a caller is from different contact groups calls based on oneor more availability statuses.

In some embodiments, the user may interact with a user interface of thevirtual assistant system 110 to input recurring or one-time events whichmay be part of the user's day-to-day activities. For example, the usermay set a rule which updates the recipient's status to “work” when thelocation module 216 determines that the recipient's mobile system, andthus the user, is at a location which corresponds with the recipient'swork address. In some embodiments, the user may set a rule which updatesthe recipient's status to “driving” when the location module 216determines that the recipient is driving. In some embodiments, anoptional notification module may send a notification of the change tothe user interface of the virtual assistant system 110.

The user may send a request to the scheduling module 218 to schedulerecurring or one-time events, such as weekly team meeting, or a dentistappointment. The scheduling module 218 may utilize the input from theuser to populate an availability status calendar such as theavailability status calendar 1100 as seen in FIG. 11. In someembodiments, the scheduling module 218 may send an API call to thecalendar function of the mobile system via the management module 204.The output of the calendar function may be the calendar output 1000 asseen in FIG. 10. The scheduling module 218 may receive the calendaroutput 1000 to determine an availability status calendar such as theexample availability status calendar 1100. When the virtual assistantsystem 110 detects an incoming call, the virtual assistant system 110utilizes the availability status calendar 1100 to determine the currentavailability status of the call recipient.

When the virtual assistant system 110 determines that there is anincoming call, the management module 204 may identify a group that thecaller belongs to and/or send a request to the availability statusmodule 212 to determine the current availability status. For example,the availability status module 212 may determine that the currentavailability status is set to “do not disturb.”

In some embodiments, callers associated with different groups mayreceive different prioritization based on the availability status of therecipient. In some embodiments, a first caller and a second caller maycall the recipient at the same time and they may both have a rule thatenables them to be directed to the recipient. In one example, a firstcaller may belong to an “immediate family” contact group and a secondcaller may belong to a “business” contact group. If the availabilitystatus is set to “personal,” the first caller may have priority over thesecond caller, meaning that the first caller may be allowed to ringthrough to the recipient, while the second caller may be presented witha voicemail prompt. However, if the availability status is set to“work,” the first caller may be presented with the voicemail prompt, andthe second caller may be allowed to ring through.

In some embodiments, if a first contact belongs to a first contact groupwith a first priority and a second contact group with a second priority,the first priority being higher than the second priority. The managementmodule 204 may allow the recipient to communicate with the first contactwith responses available to members of the first contact group. Eachcontact entry may include a name of the contact, a nickname of thecontact, and at least one phone number associated with the contact, anda label for each phone number. The contact group module 210 may send arequest to the management module 204 to make an API call to the user'smobile system for the contacts in the user's mobile system's contactlist.

In step 310, the availability status module 212 determines the currentstatus of the recipient. The availability module 212 may update acurrent availability status of the recipient periodically or when acaller calls.

The recipient or user may designate or schedule periods during a day, aweek, or a month to particular availability status. For example, therecipient may input their work hours, which is from 9 a.m. to 5:30 p.m.,Monday to Friday. In some embodiments, the availability status module212 may send a request to the management module 204 to make an API callto a calendar function of the user's mobile system. The calendarfunction may be used to determine appointments or scheduled meetings onthe user's mobile device. In response to the API call request sent bythe management module 204, the virtual assistant system 110 may receiveevent entries. Each event entry may include event properties from theuser's mobile system. Event properties may include duration, otherattendees of the event, the priority of the event, location, and thelike. The scheduling module 218 may receive event entries along withtheir associated event properties and assign an availability statuscorresponding to the event entries. For example, the management module204 sends an API call to the calendar function of the user's mobilesystem. In response, the scheduling module 218 may receive an event1040. The scheduling module 218 may receive the event 1040 and determinethat the event is a high priority and takes place on Tuesday from 12:30p.m. to 1:15 p.m., and assign that time frame a status of “do notdisturb.” If the availability status module 212 sends a request to thescheduling module 218 during the Tuesday 12:30 p.m. to 1:15 p.m. timeframe, the scheduling module 218 may send a “do not disturb”availability status to the availability status module 212.

When the virtual assistant system 110 determines that there is anincoming call from a first caller, the contact group module 210 mayreceive a request to determine if the caller ID associated with thefirst caller matches a contact entry in one of the multiple contactgroups associated with the recipient. If the contact group module 210determines that the first caller belongs to a “friends” contact groupand a “business” contact group, the contact group module 210 may send arequest to the availability status module 212 to determine the currentstatus of the recipient. If the availability status module 212determines that the availability status is current status is set to“free,” the management module 204 may prioritize the “friends” contactgroup over the “business” contact group and present the different ways“friends can communicate with the recipient. For example, the user mayset or determine the priority of one or more contact groups depending onthe availability status. An example table 1400 of FIG. 14 depicts thepriority of the various contact groups for different availabilitystatus. This table may be utilized by the management module 204 todetermine responses associated with which contact group to output whenthe particular caller belongs to two contact groups. For example, if theparticular caller belongs to both the “business” contact group and“friends” contact group, and if the availability status is set to“work,” the management module 204 may prioritize the “business” contactgroup over the “friends” contact group. In other words, the managementmodule 204 may output responses associated available to callers from the“business” contact group when the availability status is “work,” whichmay be to allow the call to ring through to the recipient.

In step 312, the recipient may set up or configure the type of responseavailable to a caller based at least on the availability status and thecontact group that the caller belongs. In some embodiments, therecipient may set a rule. In various embodiments, the recipient mayrecord and/or select audio prompts and/or text messages that may beplayed based on one or more rules.

The types of response may include allowing the call to ring through tothe recipient, providing a voicemail prompt, or disconnecting the call.In various embodiments, the recipient may record customized voicemailprompts for the virtual assistant system 110 to present to therecipient. Recipients may have different voicemail prompts depending onthe recipient's current status. In various embodiments, recipients mayhave different voicemail prompts for callers from different contactgroups.

FIG. 4 depicts a method 400 of determining example ways a caller cancommunicate with a recipient according to some embodiments. In step 402,the recipient or user of the virtual assistant system 110 receives atelephone call from a caller on their mobile system, such as the firstmobile system 102. The caller may be using a mobile system such as thesecond mobile system 104. In some embodiments, the virtual assistantsystem 110 may be installed in the second mobile system 104 as asoftware application. In various embodiments, there may be softwareinstalled on the second mobile system 104 that communicates with avirtual assistant system 110.

In step 404, the virtual assistant system 110 may receive, from thefirst mobile system 102, a caller ID. The contact group module 210 maydetermine one or more contact groups that the first caller belongs. Insome embodiments, if the caller belongs to more than one contact group,the management module 204 may prioritize one contact group over another.For example, the contact group module 210 may determine, based at leastone the caller ID associated with the caller, that the first callerbelongs to the “immediate family” and “friends” contact groups. If thecaller does not belong to a contact group, the caller may be treated asbelonging to the “unknown contact group” and/or another default contactgroup which may receive the lowest priority (e.g., since the call couldbe a spam call). Further details of the responses outputted by thevirtual assistant system 110 can be seen in FIGS. 5 through 9.

In step 406, management module 204 sends a request to the availabilitystatus module 212 for the recipient's current status. In variousembodiments, the recipient (e.g., receiver of the call) may havemanually set their status as “unavailable,” “in a meeting,” “personaltime,” “emergency contact only,” or the like.

In various embodiments, the management module 204 may determine theavailability status of the recipient automatically (e.g., based oncalendar schedule, location, or the like). In some embodiments, theavailability status module 212 may send a request to the schedulingmodule 218 for the current recipient schedule. The scheduling module 218may retrieve information from a calendar (e.g., through an API) orrequest information from a calendar (e.g., on the mobile device) todetermine any appointments or events within the calendar. The schedulingmodule 218 may be configured by the user to identify different statusbased on time and/or appointment. For example, if after work or after aparticular time, the scheduling module 218 may identify the availabilitystatus as “personal time.” If there is an appointment that is a workmeeting (e.g., from a work calendar), then the scheduling module 218 mayidentify the availability status as “unavailable,” “in a meeting,” orthe like.

If the scheduling module 218 does not have an availability statusassociated with the current time, the availability status module 212 maysend a request to other modules of the virtual assistant system 110 thedetermine the availability status. In various embodiments, theavailability status module 212 may send a request to the location module216 for a current location of the recipient, the current location of therecipient may be used to determine the current availability status. Forexample, the availability status module 212 may receive from thelocation module 216 data, which indicates that the recipient iscurrently in a location which corresponds with the recipient's workaddress. In response to the availability status module 212 receivingthis data, the availability status module 212 may determine that thecurrent status of the recipient is “busy.”

In another example, the location module 216 may determine or providedata indicating that the caller is running, in the car, or at the gym.The scheduling module 218 may provide one or more availability statusesbased on the location of the recipient (e.g., if in the car, theavailability status may be “limited” availability, and if at the gym,the availability status may be “unavailable but for emergencies”). Insome embodiments, the availability status module 212 may send a requestto the management module 204 to make an API request to one or moremobile devices associated with the recipient.

In step 408, the management module 204 determines response(s) to thecall from the first caller. For example, from steps 404 and 406 asdescribed above, the recipient's current status may be “busy at work,”and the first caller belongs to the “immediate family” and “friends”contact groups. Since the first caller belongs to both groups, themanagement module 204 may determine that the “immediate family” contactgroup has priority over the “friends” contact group. The managementmodule 204 may output a voicemail response to the caller from the“immediate family” contact group when the availability status is set towork, which may be output a voicemail prompt customized for immediatefamily members. In one example, the voicemail response may request thatthe caller text the caller if there is an emergency, input a number orother indication indicating that the call is urgent to interrupt thecaller, or to leave a voicemail that may be heard soon.

FIG. 5 depicts a method 500 of different ways the virtual assistantsystem 110 may respond to a telephone call according to someembodiments. In the illustrated figure, only one option is presented tothe caller based on the status of the recipient and the contact groupthat the caller belongs. In various embodiments, the virtual assistantsystem 110 may present more than one option to the caller based on thestatus of the recipient and the contact group that the caller belongs.

In step 502, the virtual assistant system 110 detects an incoming call.Subsequently, the availability status module 212 determines the currentstatus of the recipient. In one example, the availability status module212 may send a request to the scheduling module 218 for the currentavailability status. If the scheduling module 218 does not have aavailability status associated with the current time or a status that isset by the caller, the availability status module 212 may send a requestto other modules of the virtual assistant system 110 the determine theavailability status associated with the current time. In someembodiments, the scheduling module 218 sends the request to othermodules of the virtual assistant system 110 to determine theavailability status associated with the current time.

In step 504, the contact group module 210 determines that the callerbelongs to the “immediate family” contact group.

In step 506, the availability status module 212 determines that theavailability status is “free.”

In step 508, based on a rule established by the recipient, the virtualassistant system 110 allows the call to ring through to the recipient.If the recipient does not choose to pick up the call, the virtualassistant system 110 may output a first voicemail prompt requesting thatthe caller leave an audio message. A voice-to-text module (not depicted)of the virtual assistant system 110 may capture the audio message fromthe caller and convert the captured audio into text form. In someembodiments, the text message containing the audio-to-text conversion ofthe audio message left by the caller may be sent to the recipient. Invarious embodiments, the text message may be held for a predeterminedhold period before sending the text message to the recipient. In someembodiments, the predetermined hold period depends on the availabilitystatus and/or the contact group that the caller belongs. For example,the predetermined hold period for the text message may be shorter whenthe recipient is set to “free” status (e.g., the text may be deliveredimmediately or set to deliver with other texts at predetermined timessuch as every half hour) compared to “personal” status (e.g., the textmay be delivered after hour).

Subsequent exchanges between the first caller and the first recipientmay be accomplished by a text messaging function of the virtualassistant system 110. The text messaging function may be accomplished bythe texting module. In some embodiments, the caller may receive the textmessage in the caller's mobile system's texting software application. Invarious embodiments, the caller may receive the text message in atexting function which is integrated into the virtual assistant system.

In step 510, the availability status module 212 determines that theavailability status is set to “personal.” In response to theavailability status module 212 determining that the availability statusis set to “personal,” the method 500 proceeds to step 508. In step 508,as discussed herein, the virtual assistant system 110 allows the call toring through to the recipient.

In step 512, the availability status module 212 determines that theavailability status is set to “work.” In response to the availabilitystatus module 212 determining that the availability status is set to“work,” the method 500 proceeds to step 514. In step 514, the virtualassistant system 110 may send a request to the automated messagedatastore 220 to output a voicemail prompt requesting that the callerleave an audio message. The voicemail prompt may include a customized orpersonalized audio prompt.

In step 516, an optional voice-to-text module of the virtual assistantsystem 110 may capture the audio message from the caller and convert thecaptured audio into a text message. In some embodiments, the textmessage may be held by an optional texting module of the virtualassistant system 110 for a predetermined hold period. The predeterminedhold period may be based on the availability status and/or the contactgroup that the caller belongs. For example, the predetermined holdperiod when the availability status is set to work may be shorter thanthe predetermined hold period when the availability status is set to donot disturb (“DND”). In some embodiments, the texting module may holdthe text message until the recipient's status is no longer DND. As seenin an example table 1500 from FIG. 15, text messages from members of the“immediate family” contact group are held when the availability statusis work or DND.

In step 518, the texting module may send the captured audio from thecaller in text form to the recipient. In some embodiments, the callermay receive the text message in the caller's mobile system's textingsoftware application or through SMS or any other texting application. Invarious embodiments, the caller may receive the text message in atexting function which is integrated into the virtual assistant system110.

In step 520, the caller may respond to the recipient's message withanother text message. Subsequent exchanges between the caller and therecipient may be accomplished by a text messaging function of thevirtual assistant system 110. The exchange of messages between the firstcaller and the first recipient may be used to set up a mutuallyconvenient callback time or to schedule a meeting between the firstcaller and the first recipient. In some embodiments, the texting modulemay send a request to the scheduling module 218 to determine time framesin the recipient's schedule when the recipient is available for ameeting or a call with the first caller. In various embodiments, themanagement module 204 to make an API call to the first caller's mobilesystem to determine time frames in the recipient's schedule when therecipient is available for a meeting or a call with the first caller.The texting module may receive multiple time frames, or periods when therecipient is available, and send them to the first caller.

In step 522, the availability status module 212 determines that theavailability status is set to “do not disturb” (“DND”). In response tothe availability status module 212 determining that the availabilitystatus is set to “DND,” the method 500 proceeds to step 524. In step524, the virtual assistant system 110 may output a voicemail promptrequesting that the caller leave an audio message. The second voicemailprompt may include a customized, or personalized audio prompt. In someembodiments, the second voicemail prompt may be different from the thirdvoicemail prompt. In various embodiments, the second voicemail prompt isthe same as the third voicemail prompt.

In step 526, the voice-to-text module may capture the audio message fromthe caller and convert the captured audio into text form. In step 528,the texting module may hold the text of the captured audio until therecipient's status is no longer “DND.” In some embodiments, the textmessage may be held by the texting module for the predetermined holdperiod. The predetermined hold period may be based on the availabilitystatus and/or the contact group that the caller belongs. For example,the predetermined hold period when the availability status is set towork may be shorter than the predetermined hold period when theavailability status is set to DND. In some embodiments, the textingmodule may hold the text message until the recipient's status is nolonger “DND.” As seen in an example table 1500 from FIG. 15, textmessages from members of the “immediate family” contact group are heldwhen the availability status is work or “DND.”

In step 530, similar to step 520, the caller responds to the recipient'smessage with another text message. Subsequent exchanges between thecaller and the recipient may be accomplished by a text messagingfunction of the virtual assistant system 110.

FIG. 6 depicts a method 600 of different ways the virtual assistantsystem may connect a recipient of a telephone call with the calleraccording to some embodiments. In the illustrated figure, only oneoption is presented to the caller based on the status of the recipientand the contact group that the caller belongs. In various embodiments,the virtual assistant system 110 may present more than one option.

In step 602, similar to step 502, the virtual assistant system 110detects an incoming call. Subsequently, the availability status module212 determines the current status of the recipient. In some embodiments,the availability status module 212 sends a request to the schedulingmodule 218 for the current availability status. If the scheduling module218 does not have an availability status associated with the currenttime, the availability status module 212 may send a request to othermodules of the virtual assistant system 110 the determine theavailability status associated with the current time. In someembodiments, the scheduling module 218 sends the request to othermodules of the virtual assistant system 110 to determine theavailability status associated with the current time.

In step 604, the contact group module 210 determines that the callerbelongs to the “emergency” contact group, this may be done by comparingthe caller ID with a contact entry in the “emergency” contact group.

In step 606, the availability status module 212 determines that theavailability status is “free.”

In step 608, the virtual assistant system 110 allows the call to ringthrough to the recipient. If the recipient does not choose to pick upthe call, the virtual assistant system 110 may output the firstvoicemail prompt requesting that the caller leave an audio message. Theoptional voice-to-text module may capture the audio message from thecaller and convert the captured audio into text form. In someembodiments, the text message containing the audio-to-text conversion ofthe audio message left by the caller may be sent to the recipient withlittle to no delay. In various embodiments, the text message may be heldfor a predetermined hold period. The predetermined hold period beforesending the text message to the recipient depends on the availabilitystatus and/or the contact group that the caller belongs. For example,the predetermined hold period for the text message may be shorter whenthe recipient is set to “free” status compared to “personal” status.

In step 610, the availability status module 212 determines that theavailability status is set to “personal.” In response to theavailability status module 212 determining that the availability statusis set to “personal,” the method 600 proceeds to step 608 (i.e., thevirtual assistant system 110 allows the call to ring through to therecipient).

In step 612, the availability status module 212 determines that theavailability status is set to “work.” In response to the availabilitystatus module 212 determining that the availability status is set to“work,” the method 600 proceeds to step 608, the virtual assistantsystem 110 allows the call to ring through to the recipient.

In step 614, the availability status module 212 determines that theavailability status is set to “DND.” In response to the availabilitystatus module 212 determining that the availability status is set to“DND,” the method 600 proceeds to step 616. In step 616, the virtualassistant system 110 may output a voicemail prompt requesting that thecaller leave an audio message. The voicemail prompt may include acustomized or personalized audio prompt.

In step 618, the optional voice-to-text module may capture the audiomessage from the caller and convert the captured audio into text form.In step 620, the optional texting module may hold the text of thecaptured audio until the recipient's status is no longer “DND.” In someembodiments, the text message may be held by the texting module for apredetermined hold period. The predetermined hold period may be based onthe availability status and/or the contact group that the callerbelongs. For example, the predetermined hold period when theavailability status is set to “free” may be shorter than thepredetermined hold period when the availability status is set to “DND.”In some embodiments, the texting module may hold the text message untilthe recipient's status is no longer “DND.” As seen in an example table1500 from FIG. 15, text messages from members of the “emergency” contactgroup are held when the availability status is work or “DND.”

In step 622, the caller may respond to the recipient's message withanother text message. Subsequent exchanges between the caller and therecipient may be accomplished by a text messaging function of thevirtual assistant system 110. The exchange of messages between the firstcaller and the first recipient may be used to set up a mutuallyconvenient callback time or to schedule a meeting between the firstcaller and the first recipient. In some embodiments, the texting modulemay send a request to the scheduling module 218 to determine time framesin the recipient's schedule when the recipient is available for ameeting or a call with the first caller. In various embodiments, themanagement module 204 may make an API call to the first caller's mobilesystem to determine time frames in the recipient's schedule when therecipient is available for a meeting or a call with the first caller.The texting module may receive multiple time frames, or time periodswhen the recipient is available, and send them to the first caller.

FIG. 7 depicts a method 700 of different ways the virtual assistantsystem may connect a recipient of a telephone call with the caller whenthe virtual assistant system determines that the caller belongs to a“friends” contact group according to some embodiments.

In step 702, similar to step 502, the virtual assistant system 110detects an incoming call. Subsequently, the availability status module212 determines the current status of the recipient. As mentionedpreviously, the availability status module 212 sends a request to thescheduling module 218 for the current availability status. If thescheduling module 218 does not have an availability status associatedwith the current time, the availability status module 212 may send arequest to other modules of the virtual assistant system 110 thedetermine the availability status associated with the current time. Insome embodiments, the scheduling module 218 sends the request to othermodules of the virtual assistant system 110 to determine theavailability status associated with the current time.

In step 704, the contact group module 210 determines that the callerbelongs to the “friends” contact group, this may be done by comparingthe caller ID with a contact entry in “friends” contact group.

In step 706, the availability status module 212 determines that theavailability status is “free.”

In step 708, the virtual assistant system 110 allows the call to ringthrough to the recipient. If the recipient does not choose to pick upthe call, the virtual assistant system 110 may output the firstvoicemail prompt requesting that the caller leave an audio message. Thevoice-to-text module may capture the audio message from the caller andconvert the captured audio into text form. In some embodiments, the textmessage containing the audio-to-text conversion of the audio messageleft by the caller may be sent to the recipient with little to no delay.In various embodiments, the text message may be held for a predeterminedhold period. The predetermined hold period before sending the textmessage to the recipient depends on the availability status and/or thecontact group that the caller belongs. For example, the predeterminedhold period for the text message may be shorter when the recipient isset to a “free” status compared to “personal” status.

In step 710, the availability status module 212 determines that theavailability status is set to “personal.” In response to theavailability status module 212 determining that the availability statusis set to “personal,” the method 700 proceeds to step 708. In step 708,the virtual assistant system 110 allows the call to ring through to therecipient.

In step 712, the availability status module 212 determines that theavailability status is set to “work.” In response to the availabilitystatus module 212 determining that the availability status is set to“work,” the method 600 proceeds to step 714. In step 714, the virtualassistant system 110 may send a request to the automated messagedatastore 220 to output a voicemail prompt requesting that the callerleave an audio message.

In step 716, the voice-to-text module may capture the audio message fromthe caller and convert the captured audio into a text message.

In step 718, the text message is held by the texting module for thepredetermined hold period. The predetermined hold period may be based onthe availability status and/or the contact group that the callerbelongs. For example, the predetermined hold period when theavailability status is set to “work” may be longer than thepredetermined hold period when the availability status is set to“personal.” In some embodiments, the texting module may hold the textmessage until the recipient's status is no longer set to “work.” As seenin an example table 1500 from FIG. 15, text messages from members of the“friends” contact group are held when the availability status is set towork or “DND.”

In step 720, the caller may respond to the recipient's message withanother text message. Subsequent exchanges between the caller and therecipient may be accomplished by a text messaging function of thevirtual assistant system 110. The exchange of messages between the firstcaller and the first recipient may be used to set up a mutuallyconvenient callback time or to schedule a meeting between the firstcaller and the first recipient. In some embodiments, the texting modulemay send a request to the scheduling module 218 to determine time framesin the recipient's schedule when the recipient is available for ameeting or a call with the first caller. In various embodiments, themanagement module 204 to make an API call to the first caller's mobilesystem to determine time frames in the recipient's schedule when therecipient is available for a meeting or a call with the first caller.The texting module may receive multiple time frames, or time periodswhen the recipient is available, and send them to the first caller.

In step 722, the availability status module 212 determines that theavailability status is set to “DND.” In response to the availabilitystatus module 212 determining that the availability status is set to“DND,” the method 700 proceeds to step 724. In step 724, the virtualassistant system 110 may output a voicemail prompt requesting that thecaller leave an audio message. The voicemail prompt may include acustomized or personalized audio prompt.

In step 726, the voice-to-text module may capture the audio message fromthe caller and convert the captured audio into text form. In step 728,the texting module may hold the text of the captured audio until therecipient's status is no longer “DND.” In some embodiments, the textmessage may be held by the texting module for the predetermined holdperiod. The predetermined hold period may be based on the availabilitystatus and/or the contact group that the caller belongs. For example,the predetermined hold period when the availability status is set to“personal” may be shorter than the predetermined hold period when theavailability status is set to “DND.” In some embodiments, the textingmodule may hold the text message until the recipient's status is nolonger “DND.” As seen in an example table 1500 from FIG. 15, textmessages from members of the “friends” contact group are held when theavailability status is work or “DND.”

In step 730, the caller may respond to the recipient's message withanother text message. Subsequent exchanges between the caller and therecipient may be accomplished by a text messaging function of thevirtual assistant system 110. The exchange of messages between the firstcaller and the first recipient may be used to set up a mutuallyconvenient callback time or to schedule a meeting between the firstcaller and the first recipient. In some embodiments, the texting modulemay send a request to the scheduling module 218 to determine time framesin the recipient's schedule when the recipient is available for ameeting or a call with the first caller. In various embodiments, themanagement module 204 to make an API call to the first caller's mobilesystem to determine time frames in the recipient's schedule when therecipient is available for a meeting or a call with the first caller.The texting module may receive multiple time frames, or time periodswhen the recipient is available, and send them to the first caller.

FIG. 8 depicts a method 800 of different ways the virtual assistantsystem may connect a recipient of a telephone call with the caller whenthe virtual assistant system determines that the caller belongs to a“business” contact group according to some embodiments. In theillustrated figure, only one option is presented to the caller based onthe status of the recipient and the contact group that the callerbelongs. In various embodiments, the virtual assistant system 110 maypresent more than one option to the caller based on the status of therecipient and the contact group that the caller belongs.

In step 802, similar to step 502, the virtual assistant system 110detects an incoming call. Subsequently, the availability status module212 determines the current status of the recipient. As mentionedpreviously, the availability status module 212 sends a request to thescheduling module 218 for the current availability status. If thescheduling module 218 does not have an availability status associatedwith the current time, the availability status module 212 may send arequest to other modules of the virtual assistant system 110 thedetermine the availability status associated with the current time. Insome embodiments, the scheduling module 218 sends the request to othermodules of the virtual assistant system 110 to determine theavailability status associated with the current time.

In step 804, the contact group module 210 determines that the callerbelongs to the “business” contact group, this may be done by comparingthe caller ID with contact entries in the “business” contact group.

In step 806, the availability status module 212 determines that theavailability status is “free.” In response to the availability statusmodule 212 determining that the availability status is set to “free,”the method 600 proceeds to step 808. In step 808, the virtual assistantsystem 110 allows the call to ring through to the recipient. If therecipient does not choose to pick up the call, the virtual assistantsystem 110 may output the first voicemail prompt requesting that thecaller leave an audio message. The voice-to-text module may capture theaudio message from the caller and convert the captured audio into textform. In some embodiments, the text message containing the audio-to-textconversion of the audio message left by the caller may be sent to therecipient with little to no delay. In various embodiments, the textmessage may be held for a predetermined hold period. The predeterminedhold period before sending the text message to the recipient depends onthe availability status and/or the contact group that the callerbelongs. For example, the predetermined hold period for the text messagemay be shorter when the recipient is set to the “free” status comparedto the “personal” status.

In step 810, the availability status module 212 determines that theavailability status is set to “personal.” In response to theavailability status module 212 determining that the availability statusis set to personal, the method 800 proceeds to step 812. In step 812,the virtual assistant system 110 may send a request to the automatedmessage datastore 220 to output a voicemail prompt requesting that thecaller leave an audio message. The seventh voicemail prompt may includea customized or personalized audio prompt.

In step 814, the voice-to-text module may capture the audio message fromthe caller and convert the captured audio into a text message.

In step 816, the text message is held by the texting module for thepredetermined hold period. The predetermined hold period may be based onthe availability status and/or the contact group that the callerbelongs. For example, the predetermined hold period when theavailability status is set to work may be longer than the predeterminedhold period when the availability status is set to personal. In someembodiments, the texting module may hold the text message until therecipient's status is no longer set to “work.” As seen in an exampletable 1500 from FIG. 15, text messages from members of the “friends”contact group are held when the availability status is set to “work” or“DND.”

In step 818, the caller may respond to the recipient's message withanother text message. Subsequent exchanges between the caller and therecipient may be accomplished by a text messaging function of thevirtual assistant system 110. The exchange of messages between the firstcaller and the first recipient may be used to set up a mutuallyconvenient callback time or to schedule a meeting between the firstcaller and the first recipient. In some embodiments, the texting modulemay send a request to the scheduling module 218 to determine time framesin the recipient's schedule when the recipient is available for ameeting or a call with the first caller. In various embodiments, themanagement module 204 to make an API call to the first caller's mobilesystem to determine time frames in the recipient's schedule when therecipient is available for a meeting or a call with the first caller.The texting module may receive multiple time frames, or time periodswhen the recipient is available, and send them to the first caller.

In step 820, the availability status module 212 determines that theavailability status is set to “work.” In response to the availabilitystatus module 212 determining that the availability status is set to“work,” the method 600 proceeds to step 808. In step 808, the virtualassistant system 110 allows the call to ring through to the recipient.

In step 822, the availability status module 212 determines that theavailability status is set to “DND.” In response to the availabilitystatus module 212 determining that the availability status is set to“DND,” the method 700 proceeds to step 824, the virtual assistant system110 may output an eighth voicemail prompt requesting that the callerleave an audio message. The voicemail prompt may include a customized orpersonalized audio prompt.

In step 826, the voice-to-text module may capture the audio message fromthe caller and convert the captured audio into text form. In step 828,the texting module may hold the text of the captured audio until therecipient's status is no longer “DND.” In some embodiments, the textmessage may be held by the texting module for the predetermined holdperiod. The predetermined hold period may be based on the availabilitystatus and/or the contact group that the caller belongs. For example,the predetermined hold period when the availability status is set to“personal” may be shorter than the predetermined hold period when theavailability status is set to “DND.” In some embodiments, the textingmodule may hold the text message until the recipient's status is nolonger “DND.”

In step 830, the caller may respond to the recipient's message withanother text message. Subsequent exchanges between the caller and therecipient may be accomplished by a text messaging function of thevirtual assistant system 110. The exchange of messages between the firstcaller and the first recipient may be used to set up a mutuallyconvenient callback time or to schedule a meeting between the firstcaller and the first recipient. In some embodiments, the texting modulemay send a request to the scheduling module 218 to determine time framesin the recipient's schedule when the recipient is available for ameeting or a call with the first caller. In various embodiments, themanagement module 204 to make an API call to the first caller's mobilesystem to determine time frames in the recipient's schedule when therecipient is available for a meeting or a call with the first caller.The texting module may receive multiple time frames, or periods when therecipient is available, and send them to the first caller.

FIG. 9 depicts a method 900 of different ways the virtual assistantsystem may connect a recipient of a telephone call with the caller whenthe virtual assistant system determines that the caller belongs to a“blocked” or “unlisted” contact group according to some embodiments. Inthe illustrated figure, only one option is presented to the caller basedon the status of the recipient and the contact group that the callerbelongs. In various embodiments, the virtual assistant system 110 maypresent more than one option to the caller based on the status of therecipient and the contact group that the caller belongs.

In step 902, similar to step 902, the virtual assistant system 110detects an incoming call. Subsequently, the availability status module212 determines the current status of the recipient. As mentionedpreviously, the availability status module 212 sends a request to thescheduling module 218 for the current availability status. If thescheduling module 218 does not have a availability status associatedwith the current time, the availability status module 212 may send arequest to other modules of the virtual assistant system 110 thedetermine the availability status associated with the current time. Insome embodiments, the scheduling module 218 sends the request to othermodules of the virtual assistant system 110 to determine theavailability status associated with the current time.

In step 904, the contact group module 210 determines that the callerbelongs to the “blocked” or “unlisted” contact group. The determinationmay be done by comparing the caller ID with a contact entry in “blocked”or “unlisted” contact group. The management module 204 sends a requestto the spam caller datastore 112 to determine if the caller ID of thecaller is a scam caller or spam caller. With the advancing telephonenumber spoofing technologies, scammers or spammers may spoof the phonenumbers to hide the real caller ID of the scammer or spammer. The spamcaller datastore 112 may store the caller IDs of suspected scam callers.The virtual assistant system 110 may keep count of the number of times aparticular caller ID shows up as an entry in the spam caller datastore112. The virtual assistant system 110 may determine that at theparticular caller ID is not a suspected scam caller if the number oftimes the particular caller ID shows up as an entry in the spam callerdatastore 112 more than a predetermined number of times (e.g., over apredetermined period of time such as within an hour or repeatedly overweeks or months).

In step 906, the contact group module 210 receives, from the spam callerdatastore 112, confirmation that the caller ID of the caller matches aspam caller. In response to the contact group module 210 receiving datathat the caller is a spam caller, step 908 may proceed. In step 908, thevirtual assistant system 110 may block or disconnect the call.

In step 910, the contact group module 210 receives, from the spam callerdatastore 112, that the caller ID of the caller does not match an entryof the spam caller datastore 112. In response to this, step 912 mayproceed. In step 912, the virtual assistant system 110 may request asecond caller to input the phone number they usually call. In someembodiments, the input may be an audio form. For example, the managementmodule 204 may output an audio prompt requesting that the second callerrecord an audio message of the phone number that the second callerusually calls, this may be useful in cases when a second caller is notusing their mobile device to make a phone call. The virtual assistantsystem 110 gives the second caller a chance to communicate with therecipient, even though the second caller is not calling from theirmobile system.

In various embodiments, the input may be in text form. For example, thetexting module may send a request to the second caller to input, in theform of a text message, the phone number they usually call. In such anembodiment, step 914 may be skipped.

In step 914, the voice-to-text module converts the audio message of thephone number that the second caller usually calls into text form.

In step 916, the contact group module 210 compares the text form of thephone number the second caller usually calls from with the contactentries stored in the contact group datastore 222 to determine if thesecond caller belongs to one or more contact groups of the recipient. Ifthe second belongs to one or more contact groups, the virtual assistantsystem 110 may determine the response that the virtual assistant system110 may send to the caller. For example, if step 916 determines that thesecond caller belongs to the “emergency” contact group, and the statusof the recipient is determined in step 902 to be “free,” then, accordingto FIG. 6, the response to present to the second caller is step 608 ofFIG. 6, and the virtual assistant system 110 may allow the call from thesecond caller to ring through to the recipient.

In step 918, in the case where the contact group module 210 cannot finda match for one of the contact entries stored in the contact groupdatastore 222.

In step 920, the management module may send a request to the spam callerdatastore 112 to store the caller ID of the second caller to a list ofsuspected scam callers. In some embodiments, the contact group datastore222 stores the list of suspected scam callers. The virtual assistantsystem 110 may keep count of the number of times a particular caller IDshows up as an entry in the spam caller datastore 112. The virtualassistant system 110 may determine that at the particular caller ID isnot a suspected scam caller if the number of times the particular callerID shows up as an entry in the spam caller datastore 112 more than apredetermined number of times.

FIG. 12 depicts an example summary user interface 1200 summarizing keystatistics of the recipient's use of the virtual assistant system,according to some embodiments. The summary user interface 1200 includesa pie chart 1210, tables 1220 and 1230, and a graph 1240. The pie chart1210 illustrates a portion of time the recipient has set the virtualassistant system 110 the various availability status. Table 1220summarizes a number of text messages from each of the different contactgroups over a period of time. Table 1230 may summarize the number ofcalls and the duration of the calls from each of the different contactgroups. The graph 1240 may illustrate several calls received from callsover a segment of time.

FIG. 13 depicts a method of a text message exchange between a caller anda recipient according to some embodiments. In step 1302, the virtualassistant system 110 may output an audio prompt, such as the eighthvoicemail prompt from step 824 of FIG. 8. The audio prompt may promptthe caller to leave an audio message.

In step 1304, the caller leaves the audio message. In step 1306, thevoice-to-text module may capture the audio message from the caller andconvert the captured audio message to a first text message.

In step 1308, the texting module may send the first text message to therecipient. The recipient may receive the first text message and send asecond text back to the recipient. The texting module may be integratedinto the virtual assistant system 110 and provide a user interface whichallows the user of the virtual assistant system 110 to send and receivetext messages. In some embodiments, messages sent by the texting modulemay be in the form of an image, an emotional icon, emoji, gif, video, orsome combination thereof

The text messaging function may be accomplished by the texting module.In some embodiments, the caller may receive the text message in thecaller's mobile system's texting software application. In variousembodiments, the caller may receive the text message in a textingfunction which is integrated into the virtual assistant system.

In step 1310, the texting module may receive the second text from therecipient. Subsequent steps 1312 and 1314 may represent subsequent textexchanges between the caller and recipient.

In some embodiments, the virtual assistant system provides an automatedrecording, or a voicemail prompt, giving the user of the virtualassistant system an audio prompt identifying the contact group thecaller belongs (e.g., over a speaker of the recipient's smartphone). Inone example, the audio prompt identifies the name or nickname of thecontact who is calling. The audio prompt may provide a way for the userof the virtual assistant system to determine who is calling withoutrequiring the user to pick up the smartphone and/or distract the user,such as during driving. In some embodiments, the virtual assistantsystem may send a text message showing the name of the emergencycontact, which may be active if the user has the mobile device on silentor vibration-only mode.

In some embodiments, the virtual assistant system 110 may automaticallyconnect calls from particular contact groups after a predeterminedconnect period. The predetermined connect period may change depending onthe status of the recipient. For example, the predetermined connectperiod may be shorter when the availability status is set to “free” whencompared to when the availability status is set to “personal.” In oneembodiment, the predetermined connect period may change depending on thecontact group. For example, the predetermined connect period may beshorter for callers belonging to the “immediate family” contact groupcompared to callers belonging to the “business” contact group. Thepredetermined connect period may be customized by the user of thevirtual assistant system 110.

In some embodiments, the virtual assistant system 110 may automaticallydisconnect or send a voicemail prompt calls after a predetermineddisconnect period. The predetermined disconnect period may changedepending on the status of the recipient. For example, the predetermineddisconnect period may be longer when the availability status is set to“free” when compared to when the availability status is set to“personal.” In one embodiment, the predetermined disconnect period maychange depending on the contact group. For example, the predetermineddisconnect period may be longer for callers belonging to the “immediatefamily” contact group compared to callers belonging to the “business”contact group. The predetermined disconnect period may be customized bythe user of the virtual assistant system 110.

FIG. 16 depicts a block diagram of an example computing device 1602according to some embodiments. Computing device 1602 comprises aprocessor 1604, a memory 1606, a storage 1608, an input device 1610, acommunication network interface 1612, and an output device 1614.Processor 1604 is configured to execute executable instructions (e.g.,programs). In some embodiments, the processor 1604 comprises circuitryor any processor capable of processing the executable instructions.

Memory 1606 stores data. Some examples of memory 1606 include storagedevices, such as RAM, ROM, RAM cache, virtual memory, etc. In variousembodiments, working data is stored within memory 1606. The data withinmemory 1606 may be cleared or ultimately transferred to storage 1608.

Storage 1608 includes any storage configured to retrieve and store data.Some examples of storage 1608 include flash drives, hard drives, opticaldrives, and/or magnetic tape. Each of memory system 1606 and storagesystem 1608 comprises a computer-readable medium, which storesinstructions or programs executable by processor 1604.

The input device 1610 is any device that inputs data (e.g., mouse,keyboard, stylus). Output device 1614 outputs data (e.g., speaker,display, virtual reality headset). It may be appreciated that storage1608, input device 1610, and output device 1614 may be optional. Forexample, routers/switches may comprise processor 1604 and memory 1606 aswell as a device to receive and output data (e.g., the communicationnetwork interface 1612 and/or the output device 1614).

A communication network interface 1612 may be coupled to a network(e.g., communication network 108) via communication network interface1612. Communication network interface 1612 may support communicationover an Ethernet connection, a serial connection, a parallel connection,and/or an ATA connection. Communication network interface 1612 may alsosupport wireless communication (e.g., 802.11 a/b/g/n, WiMax, LTE, WiFi).It may be apparent that the communication network interface 1612 maysupport many wired and wireless standards.

The output device 1614 outputs data (e.g., speaker, display, virtualreality headset). It may be appreciated that the storage 1608, inputdevice 1610, and output device 1614 may be optional. For example,routers/switches may comprise processor 1604 and memory 1606 as well asa device to receive and output data (e.g., the communication networkinterface 1612 and/or the output device 1614).

A module or engine may be hardware or software. In some embodiments, themodule or engine may configure one or more processors to performfunctions associated with the module or engine. Although differentmodule or engine are discussed herein, it may be appreciated that thevirtual assistant system 110 may include any number of modules orengines performing any or all functionality discussed herein.

1. A nontransitory computer readable medium comprising instructionsexecutable by a processor, the instructions being executable to performa method, the method comprising: receiving, from a recipient, aplurality of categories of availability statuses of the recipient, eachof the categories of the plurality of categories being associated with adifferent availability status; receiving a plurality of categories ofdifferent contact groups of the recipient; identifying, for each contactof a plurality of contacts, at least one contact group of the differentcontact groups, there being at least two contacts of the plurality ofcontacts belonging to at least two different contact groups; receiving aplurality of rules for call handling, each of the plurality of rulesbeing associated with at least one of the different availabilitystatuses of the recipient and at least one of the different contactgroups, there being at least two rules of the plurality of rules, eachrule of at least two rules being associated with different availabilitystatuses of the plurality of availability statuses; receiving atelephone call from a first caller; identifying a caller identifier ofthe first caller; determining a contact group of the first caller of thedifferent contact groups; determining a current availability status ofthe recipient at the time of the call from the first caller, the currentavailability status being from the availability statuses of therecipient; identifying an applicable rule of the plurality of rulesbased on the contact group of the first caller and the currentavailability status of the recipient; selecting an audio prompt of aplurality of audio prompts based on the applicable rule, each of theplurality of audio prompts including different information; andpresenting the audio prompt to the first caller based on the applicablerule, the audio prompt indicating a preference of how the recipientprefers for the first caller to communicate with the recipient.
 2. Thenontransitory computer readable medium of claim 1, wherein the differentcontact groups include a contact group of work contacts and a group offamily contacts.
 3. The nontransitory computer readable medium of claim1, wherein the plurality of categories of availability statuses of therecipient include “busy,” “free,” and “unavailable.”
 4. Thenontransitory computer readable medium of claim 1, the method furthercomprising receiving a selection of the current availability status fromthe recipient.
 5. The nontransitory computer readable medium of claim 1,the method further comprising determining the current availabilitystatus of the recipient based on one or more entries of the recipient'scalendar indicating an activity of the recipient at a particular time.6. The nontransitory computer readable medium of claim 1, wherein theaudio prompt to the first caller indicates that the first caller shouldsend a text to the recipient and the first caller is not given theopportunity leave a voicemail during the first caller's call.
 7. Thenontransitory computer readable medium of claim 6, the method furthercomprising receiving a telephone call from a second caller; identifyinga caller identifier of the second caller; determining a contact group ofthe second caller of the different contact groups, the contact group ofthe second caller being different from the contact group of the firstcaller; identifying an applicable rule of the plurality of rules basedon the contact group of the second caller and the current availabilitystatus of the recipient; passing the call from the second callerdirectly to the recipient based on the applicable rule of the pluralityof rules based on the contact group of the second caller and the currentavailability status of the recipient.
 8. The nontransitory computerreadable medium of claim 7, the method further comprising: receiving atelephone call from a third caller; identifying a caller identifier ofthe third caller; determining a contact group of the third caller of thedifferent contact groups, the contact group of the third caller beingdifferent from the contact group of the first caller and the contactgroup of the second caller; identifying an applicable rule of theplurality of rules based on the contact group of the third caller andthe current availability status of the recipient; and providing, basedon the applicable rule of the plurality of rules based on the contactgroup of the third caller and the current availability status of therecipient, an interactive audio system requesting the third caller toindicate if their call is urgent, and if the call is urgent then passingthe call to the recipient, otherwise passing their call to a voicemailsystem.
 9. The nontransitory computer readable medium of claim 7, themethod further comprising: receiving, after the audio prompt, from thefirst caller a time when the caller is available for a return call fromthe recipient; determining if the recipient's calendar indicates thatthe time when the first caller is available for the return call from therecipient is available for the recipient; and if the recipient'scalendar indicates that the time when the first caller is available,then providing an indication in the recipient's calendar regarding thereturn call and providing an indication that the time is calendared tothe first caller.
 10. A method comprising: receiving, from a recipient,a plurality of categories of availability statuses of the recipient,each of the categories of the plurality of categories being associatedwith a different availability status; receiving a plurality ofcategories of different contact groups of the recipient; identifying,for each contact of a plurality of contacts, at least one contact groupof the different contact groups, there being at least two contacts ofthe plurality of contacts belonging to at least two different contactgroups; receiving a plurality of rules for call handling, each of theplurality of rules being associated with at least one of the differentavailability statuses of the recipient and at least one of the differentcontact groups, there being at least two rules of the plurality ofrules, each rule of at least two rules being associated with differentavailability statuses of the plurality of availability statuses;receiving a telephone call from a first caller; identifying a calleridentifier of the first caller; determining a contact group of the firstcaller of the different contact groups; determining a currentavailability status of the recipient at the time of the call from thefirst caller, the current availability status being from theavailability statuses of the recipient; identifying an applicable ruleof the plurality of rules based on the contact group of the first callerand the current availability status of the recipient; selecting an audioprompt of a plurality of audio prompts based on the applicable rule,each of the plurality of audio prompts including different information;and presenting the audio prompt to the first caller based on theapplicable rule, the audio prompt indicating a preference of how therecipient prefers for the first caller to communicate with therecipient.
 11. The method of claim 1, wherein the different contactgroups include a contact group of work contacts and a group of familycontacts.
 12. The method of claim 1, wherein the plurality of categoriesof availability statuses of the recipient include “busy,” “free,” and“unavailable.”
 13. The method of claim 1, the method further comprisingreceiving a selection of the current availability status from therecipient.
 14. The method of claim 1, the method further comprisingdetermining the current availability status of the recipient based onone or more entries of the recipient's calendar indicating an activityof the recipient at a particular time.
 15. The method of claim 1,wherein the audio prompt to the first caller indicates that the firstcaller should send a text to the recipient and the first caller is notgiven the opportunity leave a voicemail during the first caller's call.16. The method of claim 15, the method further comprising receiving atelephone call from a second caller; identifying a caller identifier ofthe second caller; determining a contact group of the second caller ofthe different contact groups, the contact group of the second callerbeing different from the contact group of the first caller; identifyingan applicable rule of the plurality of rules based on the contact groupof the second caller and the current availability status of therecipient; passing the call from the second caller directly to therecipient based on the applicable rule of the plurality of rules basedon the contact group of the second caller and the current availabilitystatus of the recipient.
 17. The method of claim 16, the method furthercomprising: receiving a telephone call from a third caller; identifyinga caller identifier of the third caller; determining a contact group ofthe third caller of the different contact groups, the contact group ofthe third caller being different from the contact group of the firstcaller and the contact group of the second caller; identifying anapplicable rule of the plurality of rules based on the contact group ofthe third caller and the current availability status of the recipient;and providing, based on the applicable rule of the plurality of rulesbased on the contact group of the third caller and the currentavailability status of the recipient, an interactive audio systemrequesting the third caller to indicate if their call is urgent, and ifthe call is urgent then passing the call to the recipient, otherwisepassing their call to a voicemail system.
 18. The method of claim 16,the method further comprising: receiving, after the audio prompt, fromthe first caller a time when the caller is available for a return callfrom the recipient; determining if the recipient's calendar indicatesthat the time when the first caller is available for the return callfrom the recipient is available for the recipient; and if therecipient's calendar indicates that the time when the first caller isavailable, then providing an indication in the recipient's calendarregarding the return call and providing an indication that the time iscalendared to the first caller.
 19. A system comprising: at least oneprocessor; and memory, the memory including instructions to control theat least one processor to: receive, from a recipient, a plurality ofcategories of availability statuses of the recipient, each of thecategories of the plurality of categories being associated with adifferent availability status; receive a plurality of categories ofdifferent contact groups of the recipient; identify, for each contact ofa plurality of contacts, at least one contact group of the differentcontact groups, there being at least two contacts of the plurality ofcontacts belonging to at least two different contact groups; receive aplurality of rules for call handling, each of the plurality of rulesbeing associated with at least one of the different availabilitystatuses of the recipient and at least one of the different contactgroups, there being at least two rules of the plurality of rules, eachrule of at least two rules being associated with different availabilitystatuses of the plurality of availability statuses; receive a telephonecall from a first caller; identify a caller identifier of the firstcaller; determine a contact group of the first caller of the differentcontact groups; determine a current availability status of the recipientat the time of the call from the first caller, the current availabilitystatus being from the availability statuses of the recipient; identifyan applicable rule of the plurality of rules based on the contact groupof the first caller and the current availability status of therecipient; select an audio prompt of a plurality of audio prompts basedon the applicable rule, each of the plurality of audio prompts includingdifferent information; and present the audio prompt to the first callerbased on the applicable rule, the audio prompt indicating a preferenceof how the recipient prefers for the first caller to communicate withthe recipient.